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(57) When transmission of on-demand video data 
interrupts transmission of broadcast video data from a 
distribution server 17 to a user terminal 18, the distribu- 
tion server 1 7 transmits substitute I frame data to the 
terminal 18 after on-demand video data transmission in 
complete and before resuming broadcast video data 



transmission. The user terminal 18 decodes and dis- 
plays the substitute I frame data, and then uses the de- 
coded substitute I frame data as a reference frame to 
decode and display the first several frames of broadcast 
video data received directly after resumption of trans- 
mission. 
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Description 

[0001] Video data transmission/reception system in 
which compressed image data is transmitted from a 
transmission-side apparatus to a reception-side appa- 
ratus 

BACKGROUND OF THE INVENTION 

(1) Field of the Invention 

[0002] The present invention relates a video data 
transmission/reception system composed of a transmis- 
sion-side and a reception-side, and in which the trans- 
mission-side transmits image data that has been com- 
pressed using motion compensation interframe predic- 
tion to the reception-side, and the reception-side de- 
codes and displays the video data. 

(2) Related Art 

[0003] In recent years services that provide video da- 
ta to users over the Internet are becoming common with 
the spread of broadband networks such as ADSL and 
FTTH. This video data is provided in a compressed form 
in order to reduce the amount of data, and one of the 
commonly used methods for such compression is that 
specified by MPEG-4. In this method, the amount of data 
is compressed by encoding using combinations of intra- 
frame/interframe encoding and motion compensation 
prediction. 

[0004] One form of this kind of video data provision 
service is a broadcast-type service (in which a transmis- 
sion-side apparatus distributes the same video data 
(broadcast video data) to a plurality of user terminals at 
the same time following a predetermined timetable). Da- 
ta provision in a broadcast -type service is performed 
through either a broadcast or a multicast called one-to- 
many communication. Since individual processing for 
different users is unnecessary in this method, the 
number of user terminals that are transmitted to can be 
increased without extra load on the transmission-side 
apparatus. 

[0005] However, services are being diversified, and 
one type of such diversification is on-demand-type data 
distribution where, in addition to simply distributing 
broadcast video data one-sidedly from the transmis- 
sion-side apparatus, different video data is distributed 
to individual user terminals in response to individual re- 
quests from the user terminals (on-demand data distri- 
bution). 

[0006] One example of such a service is, if the broad- 
cast video data being transmitted is a sports program, 
transmitting to a particular user terminal past data relat- 
ing to a particular player as appropriate, in response to 
a request from the user terminal. 
[0007] There are a number of methods that can be 
used for treating broadcast video data when transmitting 



on-demand video data to a particular user terminal while 
transmitting broadcast video data. 
[0008] One method is to continue to transmit broad- 
cast video data to the user terminal while transmitting 

.5 the on-demand video data. With this method the load 
on the user terminal is heavy because, in addition to the 
user terminal requiring sufficient communication band 
to be able to receive two types of video data simultane- 
ously, the user terminal . must also perform extra 

10 processing to decode the received video data, such as 
selective decoding and playing back. For this reason, it 
is common to use a method whereby transmission of 
the broadcast video data to the usenerminal is inter- 
rupted during transmission of the on^emand video da- 

15 ta, and only the on-demand video data is transmitted. 
[0009] However, when transmission of broadcast vid- 
eo data is interrupted for a reason such as transmission 
of on-demand video data, the following problem arises 
directly after transmission of the broadcast video data 

20 resumes. Specifically, a period of time in which video is 
not displayed occurs because the user terminal is una- 
ble to decode the broadcast video data transmitted di- 
rectly after resuming transmission. The cause of this lies 
in the video data compression method (motion compen- 

25 sation interframe prediction). The following describes 
how this problems arises, with reference to a drawing. 
[0010] FIG. 1 is a schematic diagram showing how 
video data is received by a user terminal in Internet 
broadcasting in a case in which transmission of broad - 

30 cast video data is interrupted and on-demand video data 
is transmitted. Here, reception of broadcast video data 
1 1 1 is interrupted at a time to, and on-demand video da- 
ta 112 is received instead until a time t1. Reception of 
the broadcast video data is then resumed at the time t1 . 

35 The broadcast video data 11 1 is compressed according 
to a method whereby one I frame (intraframe com- 
pressed frame) of 30 frame/sec video is provided every 
five seconds. Accordingly, one unit (GOP: Group of Pic- 
ture) consists of 1 50 frames, one of which is an I frame. 

40 The ratio of I frames is low in Internet broadcasting com- 
pared to digital broadcasting (two I frames per second 
of 30 frame/sec video). 

[001 1 ] In FIG. 1 , a GOP 1 1 1 0 is the GOP in the broad- 
cast video data 1 1 1 that is received over a period of time 

45 that includes the time t1 . The GOP 1 1 1 0 is composed of 
one I frame and a plurality of P and B frames, as are 
other GOPs. Each GOP is interframe encoded so that 
each P frame uses a nearest preceding I or P frame as 
a reference frame, and each B frame uses preceding 

so and subsequent I or P frames as a reference frames. 
[0012] Since transmission of the top three frames in 
the GOP 1110, which include the I frame, overlaps with 
transmission of the on-demand video data, the user ter- 
minal does not receive these three frames. For this rea- 

55 son, the fourth frame, which is a P frame encoded so as 
to use the head I frame as the reference frame, cannot 
be decoded. In addition, the P and B frames subsequent 
to the fourth frame are also unable to be decoded be- 
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cause they refer to the fourth frame. As a result, the vid- 
eo that corresponds to the P and B frames from the 
fourth frame onwards is not correctly displayed. This sit- 
uation continues for as many as 149 frames' worth of 
broadcast video data (just under 5 seconds) if the broad- 
cast video data has been encoded using the method 
where one I frame of 30 frame/sec broadcast video data 
is provided every 5 seconds (in the case of video data 
encoded at two I frames per second display stops for 1 4 
frames' worth (just under 0.5 seconds)). 
[0013] Possible ways of preventing this problem in-, 
elude (1) continuing transmission of broadcast video da- 
ta during on-demand video data transmission, and hav- 
ing both types of video data decoded in parallel in the 
user terminal, and (2) having the transmission appara- 
tus stagger transmission of the broadcast video data to 
the particular user terminal only, and reorganize and re- 
encode the GOP to include an I frame as the first frame 
directly after resumption, so that I frame data is always 
received first on resumption of transmission. However, 
the method described in (1) requires a wider band and 
increases the processing load of the user terminal, while 
the method described in (2) increases the load in the 
transmission-side apparatus because the apparatus 
must perform extra processing to treat the user terminal 
that receives the on-demand video data differently from 
other user terminals. This load increases as the number 
of user terminals that simultaneously receive on-de- 
mand video increases. This potentially leads to a prob- 
lem of limiting the number of users who can be broad- 
cast to simultaneously. 

SUMMARY OF THE INVENTION 

[0014] In view of the stated problem, the object of the 
present invention is to provide a video data transmis- 
sion/reception system in which when video data, which 
has been encoded using motion compensation, must be 
decoded from part way through a GOP for the above- 
described reason, a reception-side user terminal is able 
to correctly decode and display the part of broadcast vid- 
eo data that occurs directly after transmission resump- 
tion (part way through the GOP), without greatly increas- 
ing the processing load on either the transmission side 
or the reception side. 

[0015] In order to achieve the described object, the 
video data transmission/reception system of the present 
invention includes a transmission-side apparatus and a 
plurality of reception terminals, the transmission-side 
apparatus transmitting video data that has been com- 
pressed using motion compensation interframe predic- 
tion, and the reception terminals receiving the video da- 
ta and decoding the received video data, wherein the 
transmission-side apparatus includes: a first encoding 
unit operable to apply intraframe encoding processing 
or interframe encoding processing to each of a plurality 
of frames of moving image data, to generate the video 
data; a second encoding unit operable to apply, in par- 



allel with the encoding processing by the first encoding 
unit, intraframe encoding processing to a frame of the 
moving image data, to generate substitute I frame data; 
and a transmission unit operable to transmit the video 

s data and the substitute I frame data to the plurality of 
reception terminals, wherein when the transmission unit 
is to resume transmission of the video data to one of the 
reception terminals after temporarily interrupting trans- 
mission of the video data to the reception terminal, the 

10 transmission unit transmits at least one frame's worth of 
the substitute I frame data to the reception terminal be- 
fore resuming transmission of the video data, and the 
reception terminal, when the transmission unit is to 
resume the temporarily interrupted transmission of the 

is video data, receives the transmitted substitute I frame 
data, decodes the received substitute I frame data, and 
uses the decoded substitute I frame data as reference 
frame data to decode video data that is received after 
resumption of transmission. 

20 [0016] In this video data transmission/reception sys- 
tem, when resuming transmission of video data to the 
reception terminal that has temporarily stopped recep- 
tion, if the frame data directly after resumption is an in- 
terframe encoded frame (a P frame or a B frame), sub- 

25 stitute I frame data that has been generated separately 
by intraframe encoding the same frame is transmitted 
to the user terminal-side. The user terminal first decodes 
the substitute I frame data, and then decodes subse- 
quent frame data using the decoded substitute I frame 

30 data as reference frame data. Accordingly, decryption 
can be performed correctly directly after resumption 
(part way through a GO P), and therefore video data dis- 
play is not interrupted. Furthermore, there is no increase 
in the processing load of the user terminal, and the only 

35 increase in the processing load of the transmission-side 
apparatus is that for generating substitute I frame data 
and storing several frames' worth of the substitute I 
frame data. Even in a system in which video data is fre- 
quently stopped and resumed, the number of users to 

40 whom simultaneous broadcasting can be performed is 
not limited due to a processing load for stopping and 
resumption. 

[0017] Note that the stated effect can be realized in 
the transmission-side apparatus, in other words in only 

45 a video data transmission apparatus, in such a system. 
[0018] The transmission apparatus may further in- 
clude: an option data transmission unit operable to 
transmit option video data to the reception terminal, in 
parallel with the transmission of the video data, wherein 

so the interruption of video data transmission to the recep- 
tion terminal is caused by the transmission of the option 
video data. 

[0019] According to the stated structure, thestated ef- 
fect can be achieved in a video data transmission/re - 
55 ception system in which is performed a service of simul- 
taneously transmitting the same video data to multiple 
reception terminals as a broadcast, while interrupting 
transmission of the video data to one particular recep- 
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tion terminal with transmission of separate video data 
(option video data). Note that examples of option video 
data include on-demand video data and commercial vid- 
eo data. 

[0020] Furthermore, the option data transmission unit 
may include an information collection sub-unit operable 
to collect, from each of one or more of the reception ter- 
minals, information about preferences of a user of the 
reception terminal, and based on the collected informa- 
tion r select contents of option data to be transmitted. 
[0021] According to the stated structure, the stated ef- 
fect can-be realized in a video data transmission/recep- 
tion system in which the structure on the side that pro- 
vides the video data takes the initiative in transmitting 
option video data. 

[0022] Furthermore, a structure is possible in which 
the transmission unit includes a broadcast transmission 
sub-unit operable to broadcast a same data to a plurality 
of transmission destinations; and an individual transmis- 
sion sub-unit operable to transmit individual data to an 
individual transmission destination, and uses the broad- 
cast transmission sub-unit to transmit the video data, 
and the individual transmission sub-unit to transmit the 
substitute I frame data, and the option data transmission 
unit transmits the option video data in an individual 
transmission manner. In this case, since the same video 
data is broadcast, there is no increase in the processing 
load of the transmission-side apparatus even if the 
number of reception terminals increases. In addition, if 
the transmission unit includes a switch sub-unit opera- 
ble to exempt a reception terminal to which substitute I 
frame data or option video data is being transmitted from 
being a target of transmission of the video data by the 
broadcast transmission sub-unit, the reception terminal 
does not receive the broadcast video data simultane- 
ously with the option video data or the substitute I frame 
data. Therefore, large increases in the load of the net- 
work and the processing load of the reception terminal 
can be avoided. Moreover, a possible structure is one 
in which the option data transmission unit includes an 
insertion sub-unit operable to transmit secondary option 
data part way through transmission of the option data; 
and a third encoding sub-unit operable, after transmis- 
sion of the secondary option data ends and before trans- 
mission of the option data resumes, to generate option 
data substitute I frame data that corresponds to at least 
one frame of the option data starting from a frame that 
is a first frame after transmission resumption, wherein 
when transmission of the option data is to resume after 
the transmission of the secondary option data ends, the 
option data transmission unit transmits the option data 
substitute I frame data to the reception terminal before 
transmission of the option data resumes. If this structure 
is used, instead of option data being inserted in video 
data, option video data can be inserted in other option 
video data, and the stated effect can be achieved, i.e. 
the secondary option video data can be displayed di- 
rectly after transmission resumption. 



[0023] Furthermore, the first encoding unit and the 
second encoding unit may be realized in separate en- 
coders. 

[0024] According to the stated structure, there is no 

5 need for a special encoder that executes ordinary en- 
coding processing according to motion compensation 
interframe prediction in parallel with intraframe encod- 
ing processing of all frames. Instead, the stated effect 
can be realized with conventional encoders, by provid- 

10 jng two conventional encoders that perform the afore-, 
mentioned types of encoding processing respectively. 
[0025] Note that in order to achieve the stated effect, 
to determine exactly, how many frames" worth of substi- 
tute I frame data to transmit, a structure may be used in 

15 which the transmission unit determines how many 
frames of substitute I frame data to transmit to the re- 
ception terminal before resuming transmission of the 
video data, based on a GOP structure of the video data, 
and in particular, based on a frequency of appearance 

20 of frames having an I attribute or a P attribute. 

[0026] Furthermore, the same kind of effect can also 
be achieved according to a video data transmission ap- 
paratus that transmits video data that has been com- 
pressed using motion compensation interframe predic- 
ts tion to a plurality of reception terminals, including: a first 
encoding unit operable to apply intraframe encoding 
processing to a frame of moving image data, to generate 
intraframe encoded video data; a second encoding unit 
operable to apply interframe encoding processing to a 

30 frame of moving image data, to generate interframe en- 
coded video data; a video data generation unit operable 
to generate the video data from the intraframe encoded 
video data and the interframe encoded video data; and 
a transmission unit operable to transmit the video data 

35 to the plurality of reception apparatuses, wherein when 
the transmission unit is to resume transmission of the 
video data to one of the reception terminals after tem- 
porarily interrupting transmission of the video data to the 
reception terminal, the transmission unit transmits at 

40 least one frame's worth of the intraframe encoded video 
data to the reception terminal as substitute I frame data 
before resuming transmission of the video data. In this 
case, the interframe encoded data generated by the first 
encoding unit is used as the substitute I frame data. 

45 [0027] Furthermore, the video data transmission/re- 
ception system of the present invention can be realized 
by a video data transmission/reception system including 
a plurality of video data provision apparatuses, a plural- 
ity of reception terminals, and a distribution server, the 

so video data provision apparatuses transmitting video da- 
ta that has been compressed using motion compensa- 
tion interframe prediction, each reception terminal re- 
ceiving the video data from any one of the video data 
provision apparatuses and decoding the received video 

55 data, and the distribution server conveying the video da- 
ta between the video data provision apparatuses and 
the reception terminals, wherein each video data provi- 
sion apparatus includes: a first encoding unit operable 
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to apply intraframe encoding processing or interframe 
encoding processing to each of a plurality of frames of 
moving image data, to generate the video data; and a 
second encoding unit operable to apply, in parallel with 
the encoding processing by the first encoding unit, in- 5 
traframe encoding processing to each of a plurality of 
frames of the moving image data, to generate substitute 
I frame data, and the distribution server includes: a 
switch request reception unit operable to receive a re- 
quest from one of the reception terminals to switch video 10 
data received by the reception terminal to different video, 
data; and a switch transmission unit operable, on the 
switch request reception unit receiving the request, to 
stop transmission of the video data being transmitted to 
the request-originating user terminal, obtain substitute is 
I frame data from a video data provision apparatus that 
is to provide the different video data, transmit the ob- 
tained substitute I frame data to the user terminal, and 
transmit the different video data to the user terminal. 
[0028] According to this video data transmission/re- 20 
ception system, in which is performed a service of si- 
multaneously transmitting as broadcasts a plurality of 
broadcast data that can be selected by multiple recep- 
tion terminals, the reception terminal side apparatus is 
able to correctly decode broadcast video data even di- 25 
rectly after a switch from other broadcast data (part way 
through a GOP). Furthermore, neither the transmission- 
side apparatus nor the reception-side apparatus is sub- 
ject to a large increase in processing load. 
[0029] Furthermore, according to an encoder that 30 
compresses moving image data using motion compen- 
sation interframe prediction, including: a first encoding 
unit operable to apply intraframe encoding processing 
or interframe encoding processing to each of a plurality 
of frames of moving image data, to generate the video 35 
data; and a second encoding unit operable to apply, in 
parallel with the encoding processing by the first encod- 
ing unit, intraframe encoding processing to each of a 
plurality of frames of the moving image data, to generate 
substitute I frame data, if the encoded data of an I frame 40 
that is a reference frame is not sent correctly to the ap- 
paratus on the side the performs decoding, the substi- 
tute I frame data can be used instead of the I frame data 
that was not correctly sent, and therefore the I frame 
and subsequent frames that use the I frame as a refer- 45 
ence frame can be decoded correctly. The stated effect 
can be achieved if this encoder is applied to a system 
in which video data is transmitted/received as a broad- 
cast. 

[0030] Furthermore, the stated effect can be realized so 
by an encoder that compresses moving image data us- 
ing motion compensation interframe prediction, includ- 
ing: a first encoding unit operable to apply intraframe 
encoding processing to a frame of moving image data, 
to generate intraframe encoded video data; a second ss 
encoding unit operable to apply interframe encoding 
processing to a frame of moving image data, to generate 
interframe encoded video data; an encoded video data 



generation unit operable to generate encoded video da- 
ta from the intraframe encoded video data and the in- 
terframe encoded video data; and a substitute data gen- 
eration unit operable to generate substitute I frame data 
from the intraframe encoded video data. 
[0031 ] Furthermore, the described effects can also be 
achieved by a video data transmission/reception meth- 
od that a system with the above-described structure ex- 
ecutes, or by a program that has executed in a computer 
operations that correspond to the apparatuses having ; 
the described structure. • 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0032] These and other objects/advantages and fea- 
tures of the invention will become apparent from the fol- 
lowing description thereof taken in. conjunction with the 
accompanying drawings which illustrate a specific em- 
bodiment of the invention. 
[0033] In the drawings: 

FIG. 1 is a schematic diagram showing a reception 
state of various types of data in the prior art; 
FIG. 2 is a structural diagram of an embodiment of 
the video data transmission/reception system of the 
present invention; 

FIG. 3 is a schematic diagram showing a reception 
state of various types of data in the embodiment; 
FIG. 4 is a block diagram showing the structure of 
an encoder in the embodiment; 
FIG. 5 is a block diagram showing detailed structure 
of a material selection apparatus, a distribution 
server, and a user terminal in the embodiment; 
FIG. 6 is a flowchart showing the flow of substitution 
necessity judgement processing in the embodi- 
ment; 

FIG. 7 is a sequence diagram showing the flow of 
video data transmission/reception processing in the 
embodiment; 

FIGS. 8A and 8B show a structures related to the 
embodiment when routers are used; 
Fig. 9 shows a structure related to the embodiment 
when transmission/reception of on-demand video 
data is performed with the transmission side as the 
subject; 

FIG. 1 0 is a block diagram showing the structure of 
a modification example of the embodiment; 
FIG. 1 1 is a sequence diagram showing the flow of 
video data transmission/reception processing in the 
modification example; and 
FIG. 12 is a block diagram showing the structure of 
a material selection apparatus in a video data trans- 
mission/reception system in another modification 
example of the embodiment. 
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DESCRIPTION OF THE PREFERRED 
EMBODIEMNTS 

[0034] The following describes an embodiment of the 
video data transmission/reception system of the present 
invention with reference to the drawings. 

<Outline> 

[0035] FIG. 2 shows the structure of a video data 
transmission/reception system 1 of the, present embodr 
iment. In the video data transmission/reception system 
1 , video data is transmitted in broadcast form from a vid- 
eo data transmission origin via the Internet N to a user 
terminal 1 8 that wishes to receive the video data. Trans- 
mission in broadcast from denotes transmitting the 
same video data simultaneously to all users terminals 
that wish to receive the video data, following a timetable 
of which users have been notified in advance. Herein- 
after, video data that is transmitted in broadcast from is 
referred to as "broadcast video data". That is to say that 
here the term "broadcast" in broadcast video data does 
not mean transmission/reception using broadcast 
waves. 

[0036] Furthermore, in addition to broadcast video da- 
ta, the video data transmitted and received in the video 
data transmission/reception system 1 includes video 
data that is transmitted only when a request is issued 
for the video data, to a particular user terminal that has 
made the request. This video data is called "on-demand 
video data". Transmission of broadcast video data to the 
particular user terminal is interrupted while the on-de- 
mand video data is being transmitted (but broadcast vid- 
eo data continues to be transmitted to other user termi- 
nals). When transmission/reception of the on-demand 
video data is complete, transmission of broadcast video 
data to the particular user terminal resumes. 
[0037] The video data transmission/reception system 
1 enables the user terminal to correctly decode and play 
back broadcast video data directly after transmission is 
resumed, from the point of resumption of transmission 
of broadcast video data as described above. To this end, 
the characteristic of the video data transmission/recep- 
tion system 1 lies in substituting frame data of P frames 
or B frames that occur directly after resumption with I 
frame data that has been intraframe encoded separately 
from the same frames (substitute I frames). 
[0038] The following describes a specific example of 
transmission and reception of video data including sub- 
stitute I frame data, with reference to the drawings. 
[0039] In FIG. 3, a user terminal receives on-demand 
video data 23 over a period of time that spans part of 
two GO Ps 2 1 and 22 that compose broadcast video data 
20. The last frame of the on-demand video data 23 over- 
laps with the second frame, frame 222, of the GOP 22. 
Frames 223 and 224 are the frames in the broadcast 
video data 20 that occur directly after resumption. 
Frame 223 is a B frame whose reference frames for de- 



coding are an I frame 221 that is the top frame of the 
GOP 22, and the subsequent P frame 224. Furthermore, 
the reference frame of the P frame 224 for decoding is 
the I frame 221 . 

s [0040] It is necessary to refer to the I frame 221 when 
decoding the frames 223 and 224, and subsequent 
frames (frame 225 onwards) cannot be decoded if' the 
frame 224 is not decoded correctly. However, the user 
terminal 18 does not receive the I frame-221 . To solve 

10 this problem, at resumption of transmission of broadcast 
video data 20 to a user terminal 18, a material selection 
apparatus 15 does not transmit the two top frames 223 
and 224 that cannot be decoded correctly, but Instead 
transmits corresponding substitute I frame data 231 and 

15 232, 

[0041] The userterminal 1 8 decodes and displays the 
substitute I frame data 231 and 232 that corresponds to 
the frames 223 and 234. Frame 225 onwards can be 
decoded by referring to the data that results from de- 
20 coding the frame 232, and therefore do not have to be 
replaced with substitute I frame data. 

<Structure of Each Component 

25 [0042] The following describes the structure of the 
video data transmission/reception system 1 that per- 
forms the described processing. 
[0043] The video data transmission/reception system 
1 , as shown in FIG. 2, includes a plurality of user termi- 

30 nals 18 which compose a reception side and are con- 
nected via the Internal N to a transmission side. The 
transmission side includes a video camera 11 , an edit- 
ed/broadcast material server 12, a switcher 13, an en- 
coder 14, a material selection apparatus 15, an on-de- 

35 mand material server 16, and a distribution server 17. 
[0044] The video camera 1 1 provides relay video data 
which is one type of video data. The video camera 11 is 
an apparatus that converts optical images incident to an 
optical lens into electric signals. Video data is either un- 

40 compressed or compressed in a format such as DVC- 
PRO or consumer DVD, and outputs the video data to 
the switcher 13 through a signal line such as an SDI, 
and SDTIoranlEEE1394. 

[0045] The edited/broadcast material server 12 pro- 
45 vides video data of a "program" edited at a broadcast 
station, as one type of broadcast video data. In addition 
to programs that have been edited, the edited/broadcast 
material server 1 2 also holds video data and audio data 
that are used as material. These are stored on hard disk, 
so magnetic tape or the like, and output to the switcher 1 3 
as necessary. 

[0046] The switcher 13, which is located in a broad- 
cast center, edits video data obtained from the video 
camera 1 1 and the edited/broadcast material server 12, 
55 to produce broadcast data, and outputs this broadcast 
data to the encoder 14, following a predetermined time- 
table, for broadcasting. 

[0047] The encoder 1 4 generates broadcast video da- 
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ta by compressing the broadcast data from the switcher 
13 into a format (such as MPEG-4) that Is suitable for 
transmission over the Internet, and outputs the broad- 
cast video data to the material selection apparatus 15. 
Note that the broadcast data may be already encoded 5 
when it is output by the switcher 1 3. When the broadcast 
data is unable to be input into the encoder 14 as is, it is 
decoded by a decoder (not illustrated) and then input 
into the encoder 14. In addition, the encoder 14 intra- 
frame encodes each frame separately, and outputs the to 
resulting data to the material selection apparatus 15 as 
substitute I frame data. 

[0048] Specifically, the encoder 1 4 applies two differ- 
ent types of encoding processing separately to the input 
broadcast data, and outputs data resulting from each ts 
type of processing as broadcast video data and substi- 
tute I frame data, respectively. 
[0049] The structure of the encoder 14 is shown in 
FIG. 4. The encoder 1 4 differs from an ordinary encoder 
in that it has two circuits that each combine a DCT 20 
processing unit and a quantization processing unit. A 
DCT unit 141 and a quantization unit 142 in the first cir- 
cuit intraframe encode all frames in input broadcast da- 
ta, and output the resulting data as substitute I frame 
data. A DCT unit 143 and a quantization unit 144 in the 25 
second circuit intraframe encode or interframe encode 
input broadcast, and output the encoded data as broad- 
cast video data. In other words, the DCT unit 143 and 
the quantization unit 144 perform the same processing 
as the DCT unit and quantization unit in an ordinary en- 30 
coder. The respective encoded data from the first circuit 
and the second circuit are output to the material selec- 
tion apparatus 15 with the frames in synchronization. 
[0050] The on-demand material server 1 6 holds on- 
demand video data which it provides to the material se- 35 
lection apparatus 15 in response to user requests. The 
on-demand video data is stored compressed in MPEG- 
4 format in the same way as the broadcast video data. 
[0051] The material selection apparatus 15 receives 
the broadcast video data and substitute I frame data *o 
from the encoder 1 4 and the on-demand video data from 
the on-demand material server 16, and sends the re- 
ceived data to the distribution server 1 7. Here, only the 
necessary frames of the substitute I frame data are out- 
put as required. Processing relating to substitute I frame 45 
data performed by the material selection apparatus 15 
is described in more detail later. 
[0052] The distribution server 1 7 transmits the three 
types of data (broadcast video data, on-demand video 
data, and substitute I frame data) to the user terminals so 
18 via the Internet N. 

[0053] Here, the distribution server 1 7 transmits the 
broadcast video data simultaneously to all user termi- 
nals that are "broadcast targets", following a timetable. 
A user terminal that is a "broadcast target" is a user ter- ss 
minal that has issued a request to the distribution server 
1 7 for transmission of broadcast video data. 
[0054] On receiving on-demand video data from the 



material selection apparatus 15, the distribution server 

1 7 interrupts transmission of broadcast video data to the 
user terminal from which a request for the on-demand 
video data originated, and transmits the on-demand vid- 
eo data to the user terminal. 

[0055] When transmission of the on-demand video 
data is complete, the distribution server 17 transmits 
substitute I frame data to the user terminal from which 
the request for the on-demand video data originated. 
Next, afterthe transmission of the substitute I frame data 
is complete, the distribution server .17 resumes trans- 
mission of broadcast video data to the user terminal. 
[0056] The user terminal 1 8 transmits a user request 
to the server 17, and decodes and displays video data 
that is sent from the distribution server 17 in response 
to the request. In particular, when resuming reception of 
broadcast video data after on-demand video data recep- 
tion, the user terminal 18 receives substitute I frame da- 
ta, decodes and displays the substitute I frame data, and 
decodes subsequently received broadcast video data 
using the decoded substitute I frame data as reference 
frame data. 

<Description of the main compositional elements> 

[0057] The following describes the main composition- 
al elements (the material selection apparatus 15, the 
distribution server 1 7, and the user terminals 1 8) of the 
described video data transmission/reception system 1 
in further detail. 

<Detailed Structure> 

[0058] The following describes the aforementioned 
three main compositional elements of the video data 
transmission/reception system 1 of the present embod- 
iment in further detail with reference to the drawings. 
The description particularly focuses on processing re- 
lating to substitute I frame data. 
[0059] FIG. 5 is a block diagram showing the structure 
of the three main compositional elements. 

distribution Server 1 7> 

[0060] The distribution server 17 includes a request 
reception unit 1 71 , a user management unit 1 72, a video 
request unit 1 73, a video reception unit 1 74, and a video 
transmission unit 1 75. The following describes process- 
ing contents of each component. 
[0061] The request reception unit 171 receives a re- 
quest relating to video data transmission (broadcast vid- 
eo data transmission start/end request or on-demand 
video data transmission request) from the user terminal 

1 8 via the Internet N, and outputs the request to the user 
management unit 172. The request includes identifica- 
tion information (IP address, etc.) of the request-origi- 
nating userterminal.and identification information of the 
requested video data. 
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[0062] The user management unit 1 72 manages in- 
formation relating to video data transmission-destina- 
tion user terminals. The user management unit 172 
holds management information that shows identification 
information about the user terminals to which data is to 
be transmitted, and type and identification information 
(in the case of on-demand video data) about data to be 
sent to each of the user terminals. The user manage- 
ment unit 172 updates the management information in 
accordance with the contents of requests that are sent 
from users via the request. reception unit 171 . Further^ 
more, the user management unit 1 72 outputs contents 
of each received on-demand video data transmission 
request to the video request unit 1 73. 
[0063] The video request unit 173, on receiving a 
transmission request from the user management unit 
1 72 relating to on-demand video data, instructs the ma- 
terial selection apparatus 15 to read on-demand video 
data. 

[0064] The video reception unit 1 74 receives the var- 
ious types of video data from the material selection ap- 
paratus 15, and sends the video data to the video trans- 
mission unit 1 75. Note that of the video data that is sent 
from the material selection apparatus 15, the on-de- 
mand video data and the substitute I frame data have 
attached thereto the request-originating user terminal 
identification information that was included in the re- 
quest. 

[0065] Following the management information held 
by the user management unit 172, the video transmis- 
sion unit 1 75 transmits the various types of video data 
sent from the video reception unit 174, to the user ter- 
minal 18. When transmission of the on-demand video 
data and the substitute I frame data is complete, the vid- 
eo transmission unit 175 sends the transmission-desti- 
nation user terminal identification information to the user 
management unit 172, and the user management unit 
1 72 updates the contents of the management informa- 
tion for the user terminal from showing to "on-demand 
video transmission" to showing "broadcast video trans- 
mission". 

<Material Selection Apparatus 15> 

[0066] The material selection apparatus 15 includes 
a transmission/reception unit 151 , a material judgement 
unit 152, a substitute I frame buffer 153, a frame judge- 
ment unit 154, and an on-demand data reading unit 155. 
[0067] The transmission/reception unit 151 receives 
a transmission request from the distribution server 1 7 
relating to on-demand video data, and outputs the con- 
tents of the request (video data identification information 
and request-originating userterminal identification infor- 
mation) to the material judgement unit 152. In addition, 
the transmission/reception unit 151 transmits the vari- 
ous types of video data that are output via the material 
judgement unit 152 to the distribution server 17. 
[0068] The on-demand data reading unit 155 reads 



the requested on-demand video data from the on-de- 
mand material server 16, and outputs the read on-de- 
mand video data to the material judgement unit 152. 
Furthermore, when outputting the last frame of on-de- 
5 mand video data, the on-demand data reading unit 1 55 
adds information showing that the frame is the iast 
frame. 

[0069] The frame judgement unit 154 receives broad- 
cast video data from the encoder 14, and outputs the 
10 receivedbroadcastvideodatatothematerialjudgement 
unit -152: Here, the frame judgement unit 154 analyzes 
attribute information of each piece of frame data that 
composes the video data, to obtain the frame type (I, P, 
or B) and the frame serial number (showing the position 
15 of the frame in the video data overall, or the position of 
the frame in the GOP to which the frame belongs), and 
outputs this information to the material judgement unit 
1 52 together with the corresponding piece of frame da- 
ta. This information is referred to judge whether or not 
it is necessary to output substitute I frame data (this 
judgement is described later), and to specify the substi- 
tute I frame data to be output. Note that it is possible to 
have the frame judgement unit 154 count the frame se- 
rial numbers itself. 

[0070] The substitute I frame buffer 1 53 holds several 
frames' worth of substitute 1 frame data output by the 
encoder 14. Furthermore, the substitute I frame buffer 
153, which holds a counter, counts the serial numbers 
of the substitute I frame data, and attaches a serial 
numberto each piece of data (a counting method is used 
that corresponds to the serial numbers obtained by the 
frame judgement unit 154). On receiving a substitute I 
frame data output request from the material judgement 
unit 152, the substitute I frame buffer 153 outputs sub- 
stitute I frame data corresponding to the serial numbers 
attached to the request. Note that when the number of 
pieces of substitute I frame data in the substitute I frame 
buffer 153 exceeds a predetermined value, the substi- 
tute I frame buffer 153 deletes pieces of substitute I 
frame data in order from the oldest piece. 
[0071] The material judgement unit 152 obtains 
broadcast video data, on-demand video data, and sub- 
stitute I frame data, outputs the data to the transmission/ 
reception unit 151 as appropriate, thus having the data 
transmitted to the distribution server 1 7. The following 
describes, with reference to the drawings, processing 
by the material judgement unit 1 52 during transmission 
of on-demand video data, and when resuming broad- 
cast video data after completing on-demand video data 
transmission. 

[0072] FIG. 6 is a flowchart showing the flow of 
processing by the material judgement unit 152. 
[0073] When transmitting on-demand video data, the 
material judgement unit 152, on receiving requested on- 
demand video data from the on-demand data reading 
unit 155, outputs the received on-demand video data to 
the distribution server 1 7 in parallel with broadcast video 
data (S501). 



25 



30 



35 



40 



45 



50 



8 



15 



EP 1 383 334 A2 



16 



[0074] On receiving the final frame of the on-demand 
video data from the on-demand data reading unit 155 
(S502 : Yes), the material judgement unit 152 obtains 
the serial number, attribute information and so on about 
a predetermined number of frames of the broadcast vid- 5 
eo data that are to be transmitted after the last frame of 
on-demand video data (S503), and judges, based on the 
obtained information, whether to replace the frames of 
broadcast video data with substitute I frame. data. The 
frame structure at the time of encoding the broadcast io 
video data determines how many frames' worth of data 
the judgement will be performed for. As shown in FIG. 
3, the broadcast video data structure used by the 
present system 1 is a structure in which an lor a P frame 
appears at a rate of 1 frame in 3, and therefore the ma- w 
terial judgement unit 152 judges the necessity of re- 
placement for three frames. Alternatively, the material 
judgement unit 152 judges all frames until the next I 
frame appears (start of the next GOP). The material 
judgement unit 152 may repeatedly judge until an I 20 
frame in the next GOP appears if the frame structure 
(reference relation) is irregular. 
[0075] If the type of the frame that is being judged is 
T (S504:Yes), ft is not necessary to replace the frame 
with substitute I frame data because the frame and sub- 25 
sequent frames can be decoded correctly by the user 
terminal 18. Therefore, the material judgement unit 152 
notifies the distribution server 1 7 that replacement is un- 
necessary, and has the distribution server 1 7 transmit 
broadcast video data to the userterminal 1 8 (S508). The 30 
material judgement unit 152 then stops judging the ne- 
cessity of replacing frames with substitute I frame data. 
[0076] When the frame being judged is a P or B frame 
(S504 : No) , the material judgement unit 152 checks 
whether the reference frame of the frame has been 35 
transmitted to the user terminal 1 8 (in the case of a B 
frame, the first of the two reference frames) (S505). Spe- 
cifically, the material judgement unit 152 compares the 
serial number of the frame with the serial number of the 
broadcast video data frame corresponding to the last 40 
frame of the on-demand video data, and if the value of 
the former is greater than that of the latter, this means 
that the reference frame has reached the user terminal 
1 8. If the reference frame has been received by the user 
terminal 1 8 (S505 : Yes), it is possible to decode the 45 
broadcast video data frame, and therefore the material 
judgement unit 152 instructs the distribution server 17 
to transmit the frame data as is to the userterminal 18 
without replacing the frame data with substitute I frame 
data (S507). so 
[0077] Note that the reference frame serial numbers 
can be found from the serial number of the frame being 
judged and the frame structure of the broadcast video 
data. In the present example of broadcast video data 
having the frame structure shown in FIG. 3, the refer- ss 
ence frame of a P frame is the I or P frame whose serial 
number is 3 frames before that of the P frame Itself. The 
reference frames of a B frame whose serial number is 



a multiple of three (frame 223 in FIG. 3) are the I or P 
frame whose serial number is two before (frame 221 in 
FIG. 3) and the P frame whose serial number is one after 
(frame 224 in FIG. 3). For a B frame whose serial 
number is "a multiple of three - 1 " , the reference frames 
are the I or P frame whose serial number is one before 
(frame 221 in FIG. 3) and the P frame whose serial 
number is two after (frame 224 in FIG. 3). 
[0078] When the reference frame has not been trans- 
mitted (S505: No), the broadcast video data will not be 
able to be decoded by the userterminal 18, so the ma- 
teria! judgement unit 152 reads the corresponding sub- 
stitute I frame data (having the same serial number) 
from the substitute I frame buffer 153, sends the read 
substitute I frame data to the server 1 7, and has the 
server 1 7 transmit the substitute I frame data to the user 
terminal 18 (S506). Note that since it is necessary to 
transmit broadcast video data to other user terminals 
while the substitute I frame data is being transmitted to 
the userterminal 18, broadcast data is transmitted from 
the material selection apparatus 15 to the distribution 
server 1 7 in parallel with the substitute I frame data. 
[0079] The material judgement unit 152 repeats the 
processing at steps S503 to S507 until judgement has 
been performed for the predetermined number of 
frames after resumption or until I frame data of the next 
GOP appears (S509). After the processing shown in 
FIG. 6 is complete, broadcast video data that succeeds 
the frame that is subject to the check is transmitted un- 
conditionally. 

[0080] Note in the preceding description, the material 
judgement unit 1 52 judges one frame at a time whether 
or not to replace the broadcast video data with substitute 
I frame data, under the assumption that the broadcast 
video data and the on-demand video data are output to 
the distribution server 1 7 in parallel one frame at a time. 
However, it is possible to judge in advance at the start 
of on-demand video data transmission whether to sub- 
stitute or not, and the number and serial numbers of the 
frames to be substituted, based on information such as 
the frame structure at the time of encoding and the 
number of frames in the on-demand video data. Specif- 
ically, at the start of transmission of on-demand video 
data, It is possible to obtain the serial number of the 
frame of broadcast video data that corresponds to the 
first frame of on-demand video data, and calculate the 
serial number of the frame that is transmitted on re- 
sumption of transmission by adding the number of 
frames of the on-demand video data to the obtained se- 
rial number. When the frame structure of the broadcast 
video data is determined in advance as shown in the 
FIG. 3, frames having a serial number whose value is 
3n + 1 (n being an integer equal to or greater than 0) as 
described earlier are either an I frame of a P frame 
(whether the frame is an I frame or a P frame is deter- 
mined by the number of frames in the GOP), and frames 
having other serial numbers are B frames. Therefore, 
the type of a frame of broadcast video data can be easily 
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judged if the serial number of the frame that occurs at 
the time of resuming transmission is known. 
[0081 ] Note that if the serial numbers of frames to be 
substituted with substitute I frame data can be predicted 
in this way, it is possible to generate substitute I frame 
data only for the frames that are expected to be substi- 
tuted (in contrast to generating substitute I frame data 
for all frames In the description above). This enables the 
processing load, for generating substitute I frame data 
to be lightened; and is particularly effective in a system 
in which transmission requests for on-demand video da- 
ta are infrequent. 

[0082] Furthermore, it is possible to always substitute 
n frames (n being the frequency with which I or P frames 
appear) unconditionally (without judgement processing) 
directly after resumption. This eliminates the load of 
judging whether to substitute or not. As shown in FIG. 
3, the broadcast video data in the present embodiment 
has a frame structure in which an I or P frame appears 
every three frames (frequency of appearance of I or P 
frames = 3), and the reference frame of each P frame 
is the directly preceding I or P frame, while the reference 
frames of each B frame are the preceding and succeed- 
ing I or P frames. In other words, no matter what the 
type of the frame of broadcast video data directly after 
resumption is, succeeding frames can be decoded with- 
out problem if a maximum of three frames (=frequency 
of appearance of I or P frames) are substituted with sub- 
stitute I frames. 

[0083] Furthermore, if, regardless of the frequency of 
appearance of I or P frames, all frames after resumption 
are substituted with substitute I frame data until a P 
frame appears, the judgement processing load can be 
lightened because the judgement of whether or not to 
substitute need only be a check of the type of frame. In 
other words, if the frame directly after resumption is a P 
frame, only this P frame is substituted with a substitute 
I frame. If the frame directly after resumption is a B 
frame, this B frame and succeeding frames are substi- 
tuted with substitute I frames until the first subsequent 
P frame. 

<User terminal 18> 

[0084] The user terminal 18 receives the various 
types of video data from the distribution server 1 7, and 
decrypts and displays the received video data. The user 
terminal 18 includes a request receiving unit 181 that 
receives a request from the user, a request transmission 
unit 1 82 that sends the request to the distribution server 
17, a video reception unit 183 that receives video data 
sent from the distribution server 1 7 in response to the 
request, a decoder 184 that decodes video data, and a 
video display unit 185 that displays video that is the re- 
sult of decoding. 



<Flow of Video Data Transmission/ Reception 
Processing> 

[0085] The following describes exchange of the vari- 

5 ous types of data between the described main compo- 
sitional elements and the flow of processing of each 
component, in video data transmission/reception 
processing in the present video data transmission/re- 
ception system 1 , 

10 [0086] FIG. 7 is a sequence diagram showing the flow 
of processing and data exchange between a particular 
user terminal 1 8, the distribution server 1 7/ and the ma- 
terial selection apparatus 15 in the video data transmis- 
sion/reception system 1 of the present embodiment, 

15 when the user terminal 1 8 interrupts reception of broad- 
cast video data to receive on-demand video data, and 
then resumes receiving broadcast video data. 
[0087] First, the processing starts when the user ter- 
minal 1 8, which is currently receiving broadcast video 

20 data, sends an on-demand video data transmission re- 
quest to the distribution server 17 (S601). Note that 
here, although not illustrated, the distribution server 17 
is also transmitting the broadcast video data to other us- 
er terminals. 

25 [0088] The distribution server 1 7 further sends the re- 
quest to the material selection apparatus 15. 
[0089] The material selection apparatus 15, having 
received the request via the distribution server 1 7, reads 
from the on-demand video server 16 on-demand video 

30 data that corresponds to the request, and sends the 
read on-demand video data to the distribution server 1 7. 
The distribution server 17 interrupts transmission of 
broadcast video data to the user terminal 1 8, and trans- 
mits the on-demand video data to the user terminal 1 8 

35 (S602). Note that here the distribution server 1 7 contin- 
ues to transmit broadcast video data to the other user 
terminals. 

[0090] On detecting the end of the on-demand video 
data (S603), the material selection apparatus 1 5 checks 

40 attributes and reference frames of several frames of 
broadcast video data, from among the broadcast video 
data that is currently being transmitted to the other user 
terminals, that are to be transmitted to the user terminal 
1 8 directly succeeding completion of on-demand video 

45 data transmission, and judges whether of not it is nec- 
essary to transmit substitute I frame data (S604). When 
the frame type is.P or B, and the reference frame of the 
frame overlaps with the on-demand video data, and is 
therefore not received by the user terminal 18, the ma- 

so terial selection apparatus 1 5 selects a substitute I frame 
data, from among held substitute I frames, that corre- 
sponds to the frame, and sends the selected substitute 
I frame to the distribution server 17. The distribution 
server 17 transmits the substitute I frame data to the 

55 user terminal 1 8 directly after transmitting the last frame 
of on-demand video data (S605). 
[0091 ] The user terminal 1 8 decodes and displays the 
substitute I frame data (S606). 
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[0092] After transmission of the substitute I frames (or 
when transmission of substitute I frames is unneces- 
sary), the distribution server 17 resumes transmission 
of broadcast video data to the user terminal 1 8 (S607) . 
The user terminal 18 begins to decode the broadcast 5 
video data transmitted directly after resumption, using 
the decoded substitute I frame data as reference frame 
data (S608). 

<Conclusion> 10 

[0093] As has been described, in the video data trans- 
mission/reception system 1 of the present embodiment, 
when transmission of on-demand video data interrupts 
transmission of broadcast video data from the transmis- is 
sion-side apparatus from the user terminal, the trans- 
mission-side apparatus transmits substitute I frame data 
to the user terminal after completion of transmission of 
the on-demand video data and before resuming trans- 
mission of broadcast video data. The user terminal first 20 
decodes the substitute I frame data, displays the result- 
ing video data, then decodes several frames of the 
broadcast video data that occur directly after resump- 
tion, using the decoded substitute I frame as a reference 
frame, and displays the decoded broadcast video data. 25 
[0094] Accordingly, the user terminal is able to cor- 
rectly decode and display broadcast video data directly 
after on-demand video data ends. 
[0095] Note that although the material selection ap- 
paratus 1 5 and the distribution server 1 7 are described 30 
as being separate in the present embodiment, the 
present invention can also be implemented with these 
two apparatuses integrated into one apparatus. 
[0096] Furthermore, the present invention is not lim- 
ited to using the example of encoded data having a 35 
structure and reference rules described in the present 
embodiment and shown in FIG. 3 where the frequency 
of appearance of an I or P frame is 3, the reference 
frame of a P frame is the directly preceding I or P frame, 
and the reference frames of a B frame are the preceding 40 
and succeeding I or P frames. The effects of the present 
invention can be obtained regardless of the structure 
and reference rules, as long as it is possible to judge 
whether or not to substitute frames at transmission re- 
sumption as long as the reference frame of each frame & 
of broadcast video data can be specified. 
[0097] Furthermore, although the encoder 14 of the 
present embodiment is a special encoder that has a two- 
circuit DCT-quantization processing structure in which 
one circuit performs conventional processing (a mixture so 
of intraframe encoding and interframe encoding) and 
the other circuit performs only intraframe processing, it 
is possible to structure the system to have two conven- 
tional encoders, one generating substitute I frame data 
and the other generating broadcast video data. This in- ss 
creases the size of the structure because two encoders 
are required, but enables the present invention to be Im- 
plemented using only conventional encoders. 



[0098] Furthermore, data is not limited to being gen- 
erated in the described manner in which the encoder of 
the present embodiment is divided into a first and sec- 
ond circuit which have respective DCT units and quan- 
tization units and which share data generation by gen- 
erating substitute I frame data and broadcast video data, 
respectively. For example, part of the substitute I frame 
data generated by the first circuit may also be used as 
broadcastvideo data, -while the second circuit generates 
only P and B frame data. That is, the top frame of a GOP 
is intraframe encoded by the first circuit, without being 
processed by the second circuit, and the intraframe en- 
coded data from the first circuit is output to the material 
selection apparatus not only as substitute I frame datai 
for the frame, but also as part of the broadcast video 
data. In addition, the intraframe encoded data is also 
output to a reverse-quantization unit, and used as ref- 
erence frame data of subsequent frames. Other frames 
are encoded by the respective circuits in the same man- 
ner as the present embodiment. In this case, processing 
in an SW is newly required for I frames to output encod- 
ed data outputs from the first circuit as broadcast video 
data. This method lightens the processing load because 
double processing to intraframe encode the top frame 
of the GOP respectively in both the circuits is eliminated. 
[0099] The following is an example of methods of data 
transmission that may be used instead of simply trans- 
mitting data from the distribution server to the user ter- 
minals over the Internet as shown in the embodiment. 
[01 00] FIGs . 8 A and 8B show examples of video data 
transmission systems in which video data is transmitted 
from the router 17 to user terminals 718 (which collec- 
tively denotes terminals 718a, 718b, 718c, and 71 8d) 
via a router. Here, the routers 701 to 703 are multicast- 
ers. 

[0101] FIG. 8A shows the state of broadcast data 
(shown by the black arrows) being transmitted from the 
distribution server 717 to the user terminals 718. FIG. 
8B shows the state of the terminal 71 8a making a trans- 
mission request for on-demand data, and on-demand 
video data being transmitted in response to the request, 
from the distribution server 1 7 to the user terminal 71 8a. 
After on-demand video data transmission is complete, 
substitute I frame data (shown by the white arrows) is 
transmitted to the user terminal 71 8a via the same path 
as the on-demand video data, and then broadcast video 
data is again transmitted to the user terminal 718a as 
shown in FIG. 8B. 

[0102] Note that in this system the processing that re- 
lates to substitute I frame data transmission and that is 
performed by the material selection apparatus 15, the 
distribution server 17 and so on is the same as in the 
system 1 in the embodiment. 
[0103] Furthermore, the embodiment is a video data 
transmission/reception system in which transmission of 
on-demand video data interrupts transmission of broad- 
cast video data, but the structure of the system and 
types of video data in the system of the present invention 
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are not limited to those shown in the embodiment. The 
present invention applies to a system in which main vid- 
eo data that has been compressed using interf rame mo- 
tion compensation prediction is transmitted from a trans- 
mission-side apparatus to a reception apparatus, and in 5 
which there are cases of reception of main image data 
by the reception-side apparatus being interrupted. How- 
ever, the present invention does not apply to simply in- 
terrupting reception, but to the contents of the reference 
frames that remain in the decoding unitof the reception- to 
side apparatus no longercorresponding to the main vid- 
eo data frames transmitted directly after transmission 
resumes, due to interrupting reception. 
[0104] This interruption could occur when substituting 
part of the main video data with other data as described *5 
in the embodiment, or could follow another pattern such 
other data being transmitted inserted in the main video 
data, or part (I frame data in particular) of the main video 
data not being received due to communication failure. 
[0105] Furthermore, when an interruption occurs in a 20 
system in which image data is transmitted as broadcast 
data f ollowing a timetable, transmission of the broadcast 
data does resume not from the place where the inter- 
ruption occurred, but skips frames that correspond to 
the length of the interruption. In this case, even if the 25 
reception-side apparatus does not decode other data 
during the interruption, the content of the reference 
frames and the main video data will not correspond at 
resumption. Here, possible causes of interruption are 
poor communication, and transmission/reception of da- 30 
ta other than video data (for example, character data or 
still image data). 

[0106] Furthermore, the system of the present em- 
bodiment is described as being one in which on-demand 
video data is transmitted from the distribution server to 35 
a user terminal in response to a request from the user 
terminal, thus interrupting the broadcast video data. 
However, the system may be a video data transmission/ 
reception system in which the transmission side is the 
subject, and other video data is inserted into the broad- 40 
cast video data. 

[01 07] A system shown in FIG. 9 is a video data trans- 
mission/reception system 8 in which the transmission- 
side is the subject, and other video data is inserted into 
the broadcast video data. A distribution server 817 *5 
transmits other video data (for example, image data of 
commercials to suit the interests and preferences of in- 
dividual users) appropriately to individual user terminals 
18 during transmission of broadcast video data to the 
user terminals 1 8. To this end, the system 8 includes a so 
distribution material selection apparatus 801 that se- 
lects commercial video data to suit the preferences of 
individual users. The distribution material selection ap- 
paratus 601 obtains information regarding the interests 
and tastes of the individual user (for example, the age 55 
and sex of the user, and products in which he/she is in- 
terested) by means of a questionnaire or the like, from 
the user terminal via the Internet N. This information is 



used as a basis for selecting commercial video data. 
[0108] The distribution material selection apparatus 
801 may output to the material selection apparatus 815 
commercial video data based on a contract between a 
provider of pay-for-view broadcast video data that is 
transmitted as a broadcast and a sponsor, and request 
the material transmission apparatus 815 to transmit the 
commercial video data to the user terminals. In re- 
sponse, the material selection apparatus 815 outputs 
the commercial video data to a user terminal- that is a 
commercial transmission-destination, and has the user 
terminal 18 receive the commercial video data. Then, 
on detecting the end of the commercial video data; the 
material selection apparatus 815 performs the process 
shown in the first embodiment to have necessary sub- 
stitute I frame data transmitted to the user terminal 1 8 
and have transmission of broadcast video data re- 
sumed. 

[0109] In this way, the effect of the system 1 of the 
present embodiment can be obtained in a system where 
interruption and resumption of broadcast video data is 
performed with the initiative of the transmission-side ap- 
paratus. Note that the video data transmitted by the 
transmission-side apparatuses is not limited to being 
commercial video data, but may be any kind of video 
material. 

Modification Example> 

[0110] The system 1 in the above-described embod- 
iment enables broadcast video data to be correctly de- 
coded when interruption/resumption of transmission of 
broadcast video caused by transmission of on-demand 
video data occurs. In contrast, the following modification 
example solves a problem that arises in a user terminal 
that is able to receive a plurality of types of broadcast 
video data. The problem is that when switching from one 
type of broadcast video data to another, the user termi- 
nal may not be able to correctly decode the broadcast 
video data after switching until the next GOP, depending 
on the type of frame of broadcast video data that is re- 
ceived directly after the switch. 
[0111] The following describes the system of this 
modification example. Much of the structure of this sys- 
tem is the same as the system of the embodiment, and 
therefore the following description focuses of the differ- 
ences. 

[01 12] In a system 9 in FIG. 1 0, a plurality of types of 
broadcast video data is provided from a plurality of 
broadcast video data provision apparatuses 91a and 
91b (each comprising a camera and/or a material serv- 
er, a switcher, and encoder and a material selection ap- 
paratus) to a distribution server 91 7 which transmits vid- 
eo data to user terminals. The two provision apparatus- 
es provide respectively different broadcast video data 
to the distribution server 917 following predetermined 
timetables. The distribution server 91 7 transmits one of 
the types of broadcast data to a user terminal in re- 
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sponse to a request from the user terminal. In other 
words, the broadcast video data provision apparatuses 
each correspond to a different channel, and the user 
switches between the two types of broadcast video data 
as if switching channels. When switching channels 5 
(types of broadcast video data), substitute I frame data 
is transmitted to the user terminal before starting trans- 
mission of broadcast after the switch. This means that 
broadcast video data can be played back and displayed 
correctly directly after switching. 10 

<Structure> 

[0113] In the system 9, processing relating to substi- 
tute I frame data transmission at the time of switching 15 
broadcast video data is performed by the distribution 
server 917, and the material selection apparatuses 
915a and 915b in the first and second data provision 
apparatuses 91a and 91b. The following describes 
processing by these components, omitting descriptions 20 
of processing that is common with the system 1 . 
[01 14] The distribution server 91 7 receives broadcast 
video data from the first and second video provision ap- 
paratuses 91a and 91b, and transmits the respective 
types of broadcast video data to user terminals that wish 25 
to receive the types of broadcast video data. The distri- 
bution server 917 receives a broadcast video data 
switch request from the user terminal 91 8 that is receiv- 
ing video data provided by the first video data provision 
apparatus 91 a, and notifies the material selection appa- 30 
ratus 91 5b of the second video data provision apparatus 
91b that will provide broadcast video data after the 
switch, if substitute I frame data is output by the material 
selection apparatus 915b, the distribution server 917 
transmits the substitute I frame data to the user terminal 35 
91 8 after stopping transmission of the first video data to 
the user terminal 918, and then starts transmitting sec- 
ond broadcast video data to the user terminal 918. On 
the other hand, if notification that substitute I frame data 
is unnecessary is received from the material selection *o 
apparatus 915b, the distribution server 917 stops trans- 
mitting first video data to the user terminal 91 8 and starts 
transmitting second broadcast video data to the userter- 
minal918. 

[0115] On receiving notification of a switch request, 45 
the material selection apparatus 91 5b detects the frame 
to be received by the user terminal 91 8 directly after 
switching when switching is performed at this point. 
Processing after detecting this frame is the same as in 
the system 1 . Specifically, the material selection appa- so 
ratus 915b judges whether it is necessary to substitute 
the detected frame and the several frames thereafter 
with substitute I frame data, and if necessary, reads the 
substitute I frame data from the I frame buffer, and out- 
puts the frames and the frame serial numbers to the dis- 55 
tribution server 91 7. When it is not necessary to substi- 
tute the detected frame with substitute I frame data, the 
material selection apparatus 915b sends notification to 



this effect to the distribution server 91 7. In this case, the 
material selection apparatus 915b sends the frame se- 
rial number to the distribution server 91 7, and has the 
distribution server transmit the second broadcast data 
to the user terminal, starting from the frame that corre- 
sponds to the serial number. Furthermore, the distribu- 
tion server 91 7 keeps track of the frame serial numbers 
using the same method as the material selection appa- 
ratuses 915a and 915b. 

<Flowof Proce$sing> 

[0116] The following describes the flow of broadcast 
video data transmission switch processing in the 
present video data transmission/reception system 4, 
with use of a sequence diagram showing control transi- 
tion and data flow between the main compositional ele- 
ments. 

[0117] FIG. 11 is a sequence diagram showing control 
transition and data flow between the two broadcast vid- 
eo data provision apparatuses 91a and 91b, the distri- 
bution server 917, and the user terminal 918, in broad- 
cast video data transmission switching processing. This 
sequence shows a case of video data that is transmitted/ 
received switched from first broadcast video data to sec- 
ond broadcast video data. 

[0118] First, while the user terminal 918 is receiving 
first broadcast video data from the first provision appa- 
ratus 915a via the distribution server 917 (51001), the 
user terminal 918, having received an instruction from 
the user, transmits a request to switch to second broad- 
cast video to the distribution server 917 (S1002). 
[01 19] In response to the switch request the distribu- 
tion server 91 7 notifies the second video data provision 
apparatus 91b, which is the provider of the second 
broadcast video data, that a switch request has been 
made. In response, the second broadcast video data 
provision apparatus 91b judges whether it is necessary 
to substitute the frame that the user terminal 918 will 
receive directly after switching with substitute I frame 
data (S1 003), and when substitution is judged to be nec- 
essary, transmits the substitute I frame data to the dis- 
tribution server 91 7 (S1 004). The distribution server 91 7 
stops transmission of first broadcast video data to the 
user terminal 918, and transmits the received substitute 
I frame data to the user terminal 91 8. The user terminal 
918 receives, decodes and displays the substitute I 
frame data (S1005). Next, the distribution server 917 
transmits the second broadcast video data to the user 
terminal 918, starting from a part that does not need to 
be substituted with substitute I frame data. The user ter- 
minal 918 starts decoding the second broadcast video 
data using the substitute I frame data decoded at step 
S1005 as a reference frame (S1006). 
[0120] In this way, in the system 9 a plurality of video 
data provision apparatuses 91 a and 91b are connected 
to the server 917, and provide different broadcast video 
data. When there is a video data switch request from 
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the user terminal 91 8, substitute I frame data is provided 
to the user terminal 918 for a frame of video data that 
occurs directly after switching. This enables the userter- 
minal to decode and display video data without interrup- 
tion after switching broadcast video data. 5 
[01 21 ] Note that structure for reception of on-demand 
video data is not included in the modification example 
shown in FIG. 10, but a system in which substitute I 
frame data is transmitted/received either after transmis- 
sion/reception of on-demand video data or when switch- 10 
ing video data can be realized by combining the system 
of the embodiment shown in FIG. 2 with the present 
modification example. 

Modification Example 2> 15 

[0122] One possible service is one in which, during 
transmission of particular on-demand data (first on-de- 
mand data), transmission of other on-demand data 
(second on-demand data) interrupts the transmission of 20 
the first on-demand data, and then transmission of the 
first on-demand data resumes. In this case the same 
problem arises directly after switching from second on- 
demand data to first on-demand data as in the above- 
described embodiment. The present modification is a 25 
system that deals with this kind of switch. 
[0123] FIG. 12 shows a material selection apparatus 
15A in a video data transmission/reception of the 
present modification. The characteristic compositional 
element of the present modification is an on-demand da- 30 
ta reading unit 155A in the material selection apparatus 
1 5A. In addition to switching on-demand video data that 
is output to a particular terminal, the on-demand data 
reading unit 1 55A outputs substitute I frame data before 
switching back to first on-demand video data and after 35 
switching from second on-demand video data. 
[01 24] It is possible to generate substitute I frame data 
in advance for all the on-demand data, and store the 
substitute I frame data in the on-demand material server 
16, but this is impractical for such a large amount of data. 40 
Here this problem is solved by, before resuming output 
of first on-demand data, generating several frames of 
substitute I frame data from the first on-demand data 
that will be output directly after resumption, and output- 
ting the generated substitute I frame data. 45 
[0125] The structure in the on-demand data reading 
unit 155A that achieves this is a switch unit 1551, an 
auxiliary decoder 1552, and an auxiliary decoder 1553. 
Since the on-demand data reading unit 155A performs 
the same processing as the on-demand reading unit 1 55 so 
in the embodiment, a description is omitted here. 
[01 26] The switch unit 1 551 judges the serial number 
and frame type of the frame of first on-demand data that 
will be transmitted directly after transmission resump- 
tion, from the frame serial number at the point of switch- 55 
ing and the total number of frames in the second on- 
demand data. Based on the frame type, the switch unit 
1551 judges whether it is necessary to generated sub- 



stitute I frame data (unnecessary for an I frame, neces- 
sary for other frame types). If generation is necessary, 
the switch unit 1551 finds the number of frames to be 
substituted with substitute I frame data, sends informa- 
tion about the first on-demand data to the auxiliary de- 
coder 1552, and instructs the auxiliary decoder to exe- 
cute decode processing. Here, the information about the 
on-demand data includes identification information, the 
serial number of the frame that occurs directly after re- 
suming transmission, and the above-mentioned number 
of frames. The procedure for judging whether substitu- 
tion with substitute I frame data is necessary is the same 
as that performed by the material judgement unit 1 52 in 
the embodiment 

[0127] The switch unit 1551 outputs the substitute I 
frame data, which was obtained as a result of the 
processing by the auxiliary decoder 1552 and the aux- 
iliary decoder 1553 in response to the instruction, in 
place of the frames of the first on-demand data directly 
after transmission resumption. 
[01 28] On receiving an instruction from the switch unit 
1551 , the auxiliary decoder 1552 judges, based on the 
frame serial number information, which GOP in the first 
on-demand data to decode (the GOP that includes the 
frame that occurs directly after transmission resump- 
tion), and reads only this GOP from the on-demand ma- 
terial server 1 6 (referring to the identification information 
at this time). A possible method for making this judge- 
ment is to divide the value of the serial number by the 
number of frames in one GOP, and find the quotient by 
rounding off to the nearest whole number. If the quotient 
is considered to be n, the auxiliary decoder 1552 finds 
the n-th GOP from the top of the first on-demand video 
data. 

[0129] In addition, the auxiliary decoder 1552 de- 
codes the read GOP from the top frame to the frames 
to be transmitted after resumption, attaches a serial 
number to each of the decoded frames and outputs 
them to the auxiliary encoder 1 553. The auxiliary decod- 
er 1 552 also instructs the auxiliary decoder 1 553 to gen- 
erate substitute I frame data from these frames. 
[0130] The auxiliary encoder 1553 performs intra- 
frame encoding processing for all three frames received 
from the auxiliary decoder 1 552, and outputs the result- 
ing data with the respective frame serial numbers to the 
switch unit 1551. 

<Addition Observations> 

[0131] Note that although the Internet is given in the 
embodiment and the modification examples as an ex- 
ample of the communication path used when video data 
which is encoded by an encoder is distributed via the 
distribution server of an ISP (Internet Service Provider) 
or the like, the transmission/reception path used in the 
present invention is not limited to this, but another com- 
munication means such as broadcast waves or CATV 
may be used. For example, main broadcast program da- 
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ta may be transmitted/received over broadcast waves, 
and optional on-demand data transmitted/received via 
a communication line such as the Internet. 
[0132] Furthermore, although the present invention is 
a video data transmission/reception system in the em- 5 
bodiment and modification examples, the present inven- 
tion may be realized by executing a program in a com- 
puter. In this case, the program may be recorded on a 
recording medium. 

[0133] Furthermore, although the specification for w 
compressing video data is described as MPEG-4 in the 
embodiment and modification examples, the advantag- 
es of the present invention can be achieved in relation 
to all types of data that are encoded using interframe 
encoding and motion compensation interframe predic- 15 
tion. For example, the present invention can be applied 
to video data compressed using another compression 
method such as MPEG-2. 

[0134] Furthermore, although on-demand video data 
is described in the embodiment and modification exam- 20 
pies as being transmitted until completion, cases in 
which the on-demand data transmission is stopped part 
way through by a request from the user may occur The 
present invention is able to deal with such cases. Spe- 
cifically, processing that is executed when the end of the 25 
on-demand data is detected may instead be executed 
when a request is issued by the reception side appara- 
tus to stop the on-demand data part way through. 
[0135] Although the present invention has been fully 
described by way of examples with reference to the ac- 30 
companying drawings, it is to be noted that various 
changes and modifications will be apparent to those 
skilled in the art. Therefore, unless otherwise such 
changes and modifications depart from the scope of the 
present invention, they should be construed as being 35 
included therein. 

Claims 

40 

1. A video data transmission/reception system com- 
prising a transmission-side apparatus and a plural- 
ity of reception terminals, the transmission-side ap- 
paratus transmitting video data that has been com- 
pressed using motion compensation interframe 45 
prediction, and the reception terminals receiving the 
video data and decoding the received video data, 
wherein 

the transmission-side apparatus includes: 

50 

a first encoding unit operable to apply intra- 
frame encoding processing or interframe en- 
coding processing to each of a plurality of 
frames of moving image data, to generate the 
video data; 55 
a second encoding unit operable to apply, in 
parallel with the encoding processing by the 
first encoding unit, intraframe encoding 



processing to a frame of the moving image da- 
ta, to generate substitute I frame data; and 
a transmission unit operable to transmit the vid- 
eo data and the substitute I frame data to the 
plurality of reception terminals, 

wherein when the transmission unit is to 
resume transmission of the video data to one of the 
reception terminals after temporarily interrupting 
transmission^ the video data to the reception ter- 
minal, the transmission unit transmits at least one 
frame's worth of the substitute I frame data to the 
reception terminal before resuming transmission of 
the video data, and 

the reception terminal, when the transmission 
unit is to resume the temporarily interrupted trans- 
mission of the video data, receives the transmitted 
substitute I frame data, decodes the received sub- 
stitute I frame data, and uses the decoded substi- 
tute I frame data as reference frame data to decode 
video data that is received after resumption of trans- 
mission. 

2. A video data transmission apparatus that transmits 
video data that has been compressed using motion 
compensation interframe prediction to a plurality of 
reception terminals, comprising: 

a first encoding unit operable to apply intra- 
frame encoding processing or interframe en- 
coding processing to each of a plurality of 
frames of moving image data, to generate the 
video data; 

a second encoding unit operable to apply, in 
parallel with the encoding processing by the 
first encoding unit, intraframe encoding 
processing to a frame of the moving image da- 
ta, to generate substitute I frame data; and 
a transmission unit a transmission unit opera- 
ble to transmit the video data and the substitute 
I frame data to the plurality of reception termi- 
nals, and when the transmission unit is to 
resume transmission of the video data to one 
of the reception terminals after temporarily in- 
terrupting transmission of the video data to the 
reception terminal, the transmission unit trans- 
mits at least one frame's worth of the substitute 
I frame data to the reception terminal before re- 
suming transmission of the video data. 

3. The video data transmission apparatus of Claim 2, 
further comprising: 

an option data transmission unit operable to 
transmit option video data to the reception ter- 
minal, in parallel with the transmission of the 
video data, 
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wherein the interruption of video data trans- 
mission to the reception terminal is caused by the 
transmission of the option video data. 

4. The video data transmission apparatus of Claim 3, 5 
wherein the option data transmission unit 

includes an information collection sub-unit op- 
erable to collect, from each of one or more of the 
reception terminals, information about preferences 
of a user of the reception. terminal, and 1 o 

based on the collected information, selects 
contents of option data to be transmitted. 

5. The video data transmission apparatus of Claim 3, 
wherein the transmission unit includes is 

a broadcast transmission sub-unit operable to 
broadcast a same data to a plurality of transmission 
destinations; and 

an individual transmission sub-unit operable 
to transmit individual data to an individual transmis- 20 
sion destination, and 

uses the broadcast transmission sub-unit to 
transmit the video data, and the individual transmis- 
sion sub-unit to transmit the substitute I frame data, 
and 25 

the option data transmission unit transmits the 
option video data in an individual transmission man- 
ner. 

6. The video data transmission apparatus of Claim 5, 30 
wherein the transmission unit includes 

a switch sub-unit operable to exempt a recep- 
tion terminal to which substitute I frame data or op- 
tion video data is being transmitted from being a tar- 
get of transmission of the video data by the broad- 35 
cast transmission sub-unit. 

7. The video data transmission apparatus of Claim 3, 
wherein the option data transmission unit includes 

an insertion sub-unit operable to transmit sec- 40 
ondary option data part way through transmission 
of the option data; and 

a third encoding sub-unit operable, after 
transmission of the secondary option data ends and 
before transmission of the option data resumes, to 45 
generate option data substitute I frame data that 
corresponds to at least one frame of the option data 
starting from a frame that is a first frame after trans- 
mission resumption, 

wherein when transmission of the option data so 
is to resume after the transmission of the secondary 
option data ends, the option data transmission unit 
transmits the option data substitute I frame data to 
the reception terminal before transmission of the 
option data resumes. 55 

8. The video data transmission apparatus of Claim 2, 
wherein 



the first encoding unit and the second encod- 
ing unit are realized in separate encoders. 

9. The video data transmission apparatus of Claim 2, 
wherein 

the transmission unit determines how many 
frames of substitute I. frame data to transmit to the 
reception terminal before resuming transmission of 
the video data, based on a GOP structure of the vid- 
eo data, and in particular; based onafrequency of 
appearance of frames having"anl ? attribute or a P 
attribute. 

10. A video data transmission apparatus that transmits 
video data that has been compressed using motion 
compensation interframe prediction to a plurality of 
reception terminals, comprising: 

a first encoding unit operable to apply intra- 
frame encoding processing to a frame of mov- 
ing image data, to generate intraf rame encoded 
video data; 

a second encoding unit operable to apply inter- 
frame encoding processing to a frame of mov- 
ing image data, to generate interframe encoded 
video data; 

a video data generation unit operable to gener- 
ate the video data from the intraframe encoded 
video data and the interframe encoded video 
data; and 

a transmission unit operable to transmit the vid- 
eo data to the plurality of reception apparatus- 
es, 

wherein when the transmission unit is to 
resume transmission of the video data to one of the 
reception terminals after temporarily interrupting 
transmission of the video data to the reception ter- 
minal, the transmission unit transmits at least one 
frame's worth of the intraframe encoded video data 
to the reception terminal as substitute I frame data 
before resuming transmission of the video data. 

11. A video data transmission/reception system com- 
prising a plurality of video data provision apparatus- 
es, a plurality of reception terminals, and a distribu- 
tion server, the video data provision apparatuses 
transmitting video data that has been compressed 
using motion compensation interframe prediction, 
each reception terminal receiving the video data 
from any one of the video data provision apparatus- 
es and decoding the received video data, and the 
distribution server conveying the video data be- 
tween the video data provision apparatuses and the 
reception terminals, wherein 

each video data provision apparatus includes: 

a first encoding unit operable to apply intra- 
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frame encoding processing or interframe en- 
coding processing to each of a plurality of 
frames of moving image data, to generate the 
video data; and 

a second encoding unit operable to apply, in 5 
parallel with the encoding processing by the 
first encoding unit, intraframe encoding 
processing to each of a plurality of frames, of 
the moving image data, to generate substitute 
I frame data, and 10 
the distribution server includes:. 

a switch request reception unit operable to 
receive a request from one of the reception 
terminals to switch video data received by 15 
the reception terminal to different video da- 
ta; and 

a switch transmission unit operable, on the 
switch request reception unit receiving the 
request, to stop transmission of the video 20 
data being transmitted to the request-orig- 
inating user terminal, obtain substitute I 
frame data from a video data provision ap- 
paratus that is to provide the different video 
data, transmit the obtained substitute I 25 
frame data to the user terminal, and trans- 
mit the different video data to the user ter- 
minal. 

12. A distribution server in a video data transmission/ 30 
reception system that further includes a plurality of 
video data provision apparatuses and a plurality of 
reception terminals, the video data provision appa- 
ratuses transmitting video data that has been com- 
pressed using motion compensation interframe 35 
prediction, each reception terminal receiving video 
data from any one of the video data provision ap- 
paratuses, and the distribution server conveying the 
video data between the video data provision appa- 
ratuses and the reception terminals, the distribution *o 
server comprising: 

a switch request reception unit operable to re- 
ceive a request from one of the reception ter- 
minals to switch video data received by the re- 45 
ception terminal to different video data; and 
a switch transmission unit operable, on the 
switch request reception unit receiving the re- 
quest, to stop transmission of the video data be- 
ing transmitted to the request-originating user so 
terminal, obtain substitute I frame data from a 
video data provision apparatus that is to pro- 
vide the different video data, transmit the ob- 
tained substitute I frame data to the user termi- 
nal, and transmit the different video data to the 55 
user terminal. 

13. A video data provision apparatus in a video data 



transmission/reception system that includes a plu- 
rality of video data provision apparatuses, a plurality 
of reception terminals, and a distribution server, the 
video data provision apparatuses transmitting video 
data that has been compressed using motion com- 
pensation interframe prediction, each reception ter- 
minal receiving video data from any one of the video 
data provision apparatuses, and the distribution 
server conveying the video data between the, video 
data provision apparatuses and the reception ter- 
minals, the video data provision apparatus compris- 
ing: 

a first encoding unit operable to apply intra- 
frame encoding processing or interframe en- 
coding processing to each of a plurality of 
frames of moving image data, to generate the 
video data; 

a second encoding unit operable to apply, in 
parallel with the encoding processing by the 
first encoding unit, intraframe encoding 
processing to each of a plurality of frames of 
the moving image data, to generate substitute 
I frame data; and 

a transmission unit operable to transmit the vid- 
eo data to the distribution server, and, when 
one of the reception terminals requests to 
switch video data being received to the video 
data being transmitted by the transmission unit, 
transmit at least one frame of substitute I frame 
data to the reception terminal via the distribu- 
tion server, before the switch. 

14. An encoder that compresses moving image data 
using motion compensation interframe prediction, 
comprising: 

a first encoding unit operable to apply intra- 
frame encoding processing or interframe en- 
coding processing to each of a plurality of 
frames of moving image data, to generate the 
video data; and 

a second encoding unit operable to apply, in 
parallel with the encoding processing by the 
first encoding unit, intraframe encoding 
processing to each of a plurality of frames of 
the moving image data, to generate substitute 
I frame data. 

15. An encoder that compresses moving image data 
using motion compensation interframe prediction, 
comprising: 

a first encoding unit operable to apply intra- 
frame encoding processing to a frame of mov- 
ing image data, to generate intraframe encoded 
video data; 

a second encoding unit operable to apply inter- 
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frame encoding processing to a frame of mov- 
ing image data, to generate interframe encoded 
video data; 

an encoded video data generation unit opera- 
ble to generate encoded video data from the 5 
intraframe encoded video data and the inter- 
frame encoded video data; and 
• a substitute data generation unit operable to 
generate substitute I frame data from the intra- 
frame encoded video data. 10 

16. A video data transmission/reception method used 
by a transmission -side apparatus and one of a plu- 
rality of reception terminals in a video data trans- 
mission/reception system in which the transmis- 15 
s ion-side apparatus that transmits video data that 
has been compressed using motion compensation 
interframe prediction, and the plurality of reception 
terminals receive the video data and decode the re- 
ceived video data, the method comprising: 20 

a first encoding step, in the transmission-side 
apparatus, of applying intraframe encoding 
processing or interframe encoding processing 
to each of a plurality of frames of moving image 25 
data, to generate the video data; 
a second encoding step, in the transmission- 
side apparatus, of applying, in parallel with the 
first encoding step, intraframe encoding 
processing to each of a plurality of frames of 30 
the moving image data, to generate substitute 
i frame data; 

a video data transmission step, in the transmis- 
sion-side apparatus, of transmitting the video 
data to a reception-side apparatus; 35 
a transmission interruption step, in the trans- 
mission-side apparatus, of interrupting trans- 
mission of the video data to the reception-side 
apparatus; 

a substitute data transmission step, in the 40 
transmission-side apparatus, of transmitting at 
least one frame's worth of the substitute I frame 
data to the reception terminal; 
a substitute data decoding step, in the recep- 
tion terminal, of decoding the substitute I frame 45 
data; 

a video data retransmission step, in the trans- 
mission side apparatus, of resuming transmis- 
sion of the video data to the reception terminal; 
and so 
a video data decoding step, in the reception ter- 
minal, of decoding the video data received after 
resumption of transmission, using data ob- 
tained as a result of executing the substitute da- 
ta decoding step, as reference frame data. 55 

17. A program for having executed in a computer a vid- 
eo data transmission method used by a transmis- 



sion-side apparatus in a video data transmission/ 
reception system in which the transmission-side ap- 
paratus that transmits video data that has been 
compressed using motion compensation interframe 
prediction, and a plurality of reception terminals re- 
ceive the video data and decode the received video 
data, the method comprising: 

a first encoding step of applying intraframe en- 
coding processing or interframe encoding 
processing to each of a plurality of frames of 
moving image data, to generate the video data; 
a second encoding step of applying, in parallel 
with the first encoding step, intraframe encod- 
ing processing to each of a plurality of frames 
of the moving image data, to generate substi- 
tute I frame data; 

a video data transmission step of transmitting 
the video data to a reception -side apparatus; 
a transmission Interruption step of interrupting 
transmission of the video data to the reception- 
side apparatus; 

a substitute data transmission step of transmit- 
ting at least one frame's worth of the substitute 
I frame data to the reception terminal; and 
a video data retransmission step of resuming 
transmission of the video data to the reception 
terminal. 
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